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(57) Abstract: A method and apparatus for ranking pixels in an image by 
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for any one of the pixels at coordinates (x,y) has a different scale s, cal- 
culating (230) an thropy value for each of the regions, identifying (260) 
any of the regions as having a peak entropy value, wighting (270) the 
peak entropy value of each of the peak entropy regions by a weight value 
corresponding to a peak width esimate of the peak entropy value, and 
randking (290) the regions by the weighted peak entropy values, thereby 
ranking the pixels.The invention can be included in a method and appara- 
tus for image transmission, providing preferential transmission of salient 
portions of the image. This is particularly advantageous in image trans- 
mission over radio links of limited bandwith. 
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Method and Apparatus for Determining Regions of Interest in Images and for i 

Image Transmission 

Field of tlie Invention 

The present invention relates generally to the field of image processing. More 
particularly, but not exclusively, the invention concerns methods and apparatus for 
determining regions of interest in images for transmission. 

Badkground of the Invention 

There is a widening gap between demand for data transmitted via computer networks and 
available bandwidth. Similarly, there is a great demand for the transmission of data over 
digital radio links, for example to and from mobile radios and mobile 'phones. This has 
fueled the search for improved methods of data compression and more efficient 
transmission technologies. 

Prior art transmission technologies that are particularly suited for video applications focus 
on interpreting image data at the transmission source, transmitting the interpretation data 
rather than the image itself, and using the interpretation data at the destination. The 
interpretation data may or may not be transmitted in compressed form. 

Two alternative approaches to image interpretation are the Mmage-driven', or bottom-up, 
approach, and the 'model-driven', or top-down, approach. 

The image-driven approach relies on features in the image, such as edges or comers, to 
propagate "naturally*' and form meaningful descriptions or models of image content. A 
typical example is figure-ground image segmentation, where the task is to separate the 
object of interest in the foreground firom the backgroimd. 

In the model-driven approach, information regarding content expectation is used to 
extract meaning from images. A typical example is object recognition where an outline 
Computer- Aided Design (CAD) model is compared to edges found in the image - an 
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approach conunonly used in tnanufacturing line inspection applications. 

The key difference between the image driven and model driven approaches is in the 
feature grouping stage. In ttie image-driven approach, the cues for feature grouping come 
from ttie image, whereas in the model-driven approach the cues come from the 
comparison models. 

In one variation of an image-driven approach, a numb^ of small salient patches or icons' 
are identified within an image. These icons represent descriptors of areas of interest. In 
this approach saliency is defined in terms of local signal complexity or unpredictability, 
or, more specifically, the entropy of local attributes. Icons with a high signal complexity 
have a flatter intensity distribution, and, haice, a higher entropy. In more general terms, it 
is the high complexity of any suitable descriptor that may be used as a measure of local 
saliency. 

Known salient icon selection techniques meeisure the saliency of icons at the same scale 
across the entire image. The scale to use for selection across the whole image may be 
chosen in several ways. Typically, the smallest scale at which a maximum occurs in the 
average global entropy is chosen. However, the size of image features varies. Therefore a 
scale of analysis fliat is optimal for a given feature of a given size might not be optimal 
for a feature of a different size. 

There is therefore a need to further improve salient icon selection techniques. 
Summary of the Invention 

The present invention discloses methods and apparatus for determining regions of interest 
in images. The present invention provides ways of extending the saliency measure to 
scale, and thereby finding features that exist at a very narrow range of scales. This yields 
salient icons having an optimum level of entropy. 

In accordance with a preferred embodiment of the present invention, a method for ranking 
pixels in an image by degrees of saliency includes the steps of: defining a pliu^ty of 
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regions for each of a plurality of pixels in an image^ where each of fhe regions for any one 
of the pixels at coordinates (x,y) has a different scale s\ calculating an entropy value for 
each of the regions; identifying any of the regions as having a peak entropy value; 
weighting the peak entropy value of each of the peak entropy regions by a weight value 
corresponding to a peak width estimate of the peak entropy value; ranking the regions by 
the weigihted peak entropy values, thereby ranking the pixels. 

Further in accordance with a preferred embodiment of the present invention, the 
calculating step may include calculating a probability density function (PDF) estimate for 
the pixels within each of the regions. The calculating step may include calculating using a 
Farzen window PDF estimator. 

Additionally, the calculating step may include calculating using histogram binning. The 
method may further include the step of applying a 3-tap averaging to the peak width 
estimate prior to performing the weighting step. 

Further in accordance with a preferred embodiment of the present invention the weighting 
step may include weighting in accordance with a value W(x,y,s) according to the formula 
S(x,y.s) -=H(x,y,s) - W(x,y,s) 
where 

t 

and H(x,y,s) is the entropy of region (x,y,s), and pi are discrete probabilities. 

There is also provided in accordance with a preferred embodiment of fhe present 
invention a method for determining regions of saliency in an image, the method including 
fhe steps of a) defining a plurality of regions for each of a plurality of pixels in an image, 
where each of the regions for any one of the pixels at coordinates (x,y) has a difii^ient 
scale Sy b) calculating an entropy value for each of the regions, c) identifying any of the 
regions as having a peak entropy value, d) wei^ting &e peak entropy value of each of 
the peak entropy regions by a weight value corresponding to a peak width estimate of the 
peak entropy value, and e) for each selected one of the peak entropy regions f) selecting at 
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least one neighboring region of peak entropy, g) determining liie mean and variance of 
each of jc, y, and s for flie selected peak entropy region and the at least one nei^boring 
region, and where the largest of the variances does not exceed a predetermined threshold, 
h) removing from the peak entropy regions any regions within a predetermined distance 
from the mean (x,y,s) point, and i) storing the mean values, thereby designating a region 
of interest. 

Further in accordance with a preferred embodiment of the present invention the method 
further includes performing step e) m order of the weighted peak entropy values. 

The invention forther comprises a method of image transmission in accordance with 
appended claim 11, and devices in accordance with appended claims 12 and 13. 

Brief description of the drawings 

The present mvention will be imderstood and appreciated more fully from the following 
detailed description taken in conjunction with the appeaided drawings in which: 
Fig. 1 A is a simplified illustration of an exemplary icon 10, useful in understandmg the 
present invention; 

Fig. IB is a snnplified graphical illustration of an entropy analysis for points Pi and P2 of 
Fig. 1 A, useful in understanding the present invention; 

Fig. 2 is a simplified flowchart ilhistration of a method for determining icon salience, 
operative in accordance with a preferred embodiment of the present invention; 
Fig. 3 is a simplified flowchart illustration of a method for selecting salient regions, 
operative in accordance with a preferred embodiment of the present invention; and 
Fig. 4 is a simplified pictorial illustration showing the results of an implementation of the 
method of Figs. 2 and 3 . 

Fig. 5 illustrates a device for rankmg pixels in an image by degrees of saliency, in 
accordance with an embodiment of the invention. 

Figs. 6 and 7 illustrate applications of the invention to the recognition of salient features 
and scales in fingerprint images. 



wo 02/31766 



5 



PCT/EPOl/11715 



DetaUed Description of Preferred Embodiments 

The present invention extends prior art measures of saliency, so as to be able to compare the 
salience of both different spatial points and scales. The invention allows the selection of 
certain salient scales and salient spatial locations simultaneously. Inherent in this idea is that a 
feature may have a different saliency value at different scales. The invention allows a direct 
comparison of these. 

Most multi-scale ^proaches to signal processing fall into two main categories. Schemes in the 
first category attempt to capture the multi-scale nature of signals by processing a complete 
multi-scale representation of the signal. Schemes in the second category attempt to find a best 
scale or set of scales to represent the signal, often parsing a complete multi-scale representation 
in order to choose the particular scale(s) of interest The invention is a development in die 
general area of die second tiiese two approaches. 

Icon Scale Selection and Calculating Saliencv Values 

The method of the invention is best explained by considering the behaviour of the entropy 
scale metric with varying scale parameter. 

The problem of scale selection may be seen with reference to Fig. lA and Fig. IB. Fig. 
lA is a simplified illustration of an exemplary icon 10. Fig. IB is a simplified graphical 
illustration of an entropy cmalysis for points Pi and P2. 

In Fig, lA, icon 10 is illustrative of a feature within an image. The feature is shown as a 
circle for purposes of illustration. In a real image, features clearly may be radically 
different in shape from this idealised case. 

Considering Fig. 1 A, icon 10 is shown comprising a circle 12 in which two points Pi and 
P2 are indicated at the edge and center of circle 12 respectively. The whole of circle 12, 
including points Pi, and P2, is to be imderstood as being an entirely black icon/feature on 
the image. However, Fig. 1 A shows the area within circle 12 as a hatched region, in order 
that the locations of points Pi, and P2 can be recognised on the figure. 
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A square 14 around circle 12 represents the bounding square for the scale at which the 
peak in entropy for icon 10 occurs, when taken about point P2. This entropy peak is 
illustrated in Fig. IB as the maximum in the entropy plot marked P2. 

There is clearly a maxunum in both plots PI and P2, for points Pi and P2 respectively, in 
Fig. IB. It would not be clear which of Pi and Pz would be most salient based on peak 
entropy alone, as both Pi and Pzhave peak entropy values, albeit at different scales. Thus, 
both plots would appear to be equally useful in determining the appropriate scale. 

However, it may also be seen m Fig. IB that the two plots for entropy versus scale have 
diflFerent peak widths. In Fig. IB the plot for Pi is approxunately twice as wide as that for 
P2. It is commonly assumed that a feature that is present across a large number of scales is 
particularly salient However, as described above, saliency is based on complexity, 
dejBned in terms of unpredictability. In real-life images this exists at a small number of 
scales and spatial locations, and hence is considered to be relatively rare. If an image was 
complex and unpredictable at all spatial locations and scales, then it would either be a 
random image or ftactal-like. Hence, in Fig. IB the peak of P2 is actually of greater 
salience than that of Pi. It should be noted that a given point may have several peaks of 
entropy, each at a different scale. 

This analysis of Fig. IB mdicates diat the width of the entropy plot taken about different 
points on an hnage might serve as a useful mdicator. Notably, a saliency estimate based 
on peak height alone does not enable a distinction to be made between the two plots on 
figure IB. 

Reference is now made to Fig. 2, which is a simplified flowchart illustration of a method 
for determining icon salience, operative m accordance with a preferred embodiment of 
the present inventioiL 
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In the method of Fig. 2, a circular region of a radius s, typically initialized to a minimum 
scale value (step 200), is defined around a pixel at coordinates (x,y) in an image (step 
210). The probability density function (PDF) of the values of the pixels within the region 
is then estimated (step 220). The values may be gray level intensity values, color levels, 
or any other characteristic used to define the type of interest desired for image features. A 
Parzen window PDF estimator is preferably used where a pre-defined kernel is placed on 
the data points in the sample set. The PDF estimation is ihsa the sum of all kemels across 
the data axis. A Gaussian kernel is preferably used for its mathematical tractability and 
resulting smooth PDF estimate, where fhe sigma controls the degree of smoothing applied 
to the PDF estimate. Since there is no arbitrary binning, the entropy value is stable under 
linear intensity shifts. 

A basic histogram biiming method may be used as an alternative to the Parzen window 
PDF estimation algorithm. In this method, instead of placing a kernel (e.g., a Gaussian 
kernel) on each data point and tiien summing all the kemels to calculate the PDF 
estimate, the data axis is simply divided into a number of bins, for example 16 or 32 bins, 
with each bin having upper and lower data values. A count for each bin is kept and is 
incremented for every pixel within the local window that is between the upper and lower 
data values for that bin. 

Once the PDF is calcidated, the entropy /f of region (x,y,s) is then calculated (step 230) 
using the formula: 

I 

where pi are the discrete probabilities, and 0^,<=1. 

Radius s is then increased by the next scale increment (step 240), and the previous steps 
are repeated for all scales of s between s\ and a maximum scale value S2 (step 250). Once 
the entropy has been calculated for all regions between Si and S2 for pixel (x,y), those 
regions having a peak entropy relative to the entropy of the immediately preceding and 
succeeding regions are determined (step 260). 

The entropy H of each peak region is then weighted in accordance with a value W(x,y,s) 
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which is proportional to its peak width estimate (step 270), in order to provide a measure 
of salimcy S using the formula 

where 

270 are then preferably repeated for all pixels in the image (step 280). Once the entropy 
values of regions of peak entropy have been weighted, they are preferably ranked by 
weighted peak entropy value, thus resulting in a rankmg of the pixels by peak saliency 
(step 290). 

The method of the invention is novel due to the use of peak width as a weighting fector in 
the calculation of saliency. However, the actual technique selected for peak width 
estimation represents a further refinement of the broad idea of using the peak width. 

The inventors have chosen a technique for peak width estimation that involves calculating 
the sum of absolute gradients of the histogram measured at Ihe peak. The histogram 
meant here is an approximation to the continuous probability dmsity fimction (PDF) of 
tibie intensity distributions around the points such as PI and P2 in Figure 1 A. If the sum is 
large, tiiis indicates that the peak in the intensity distribution, see Fig. IB, is quite sharp. 
A small value of the sum indicates that the peak is likely to be quite wide. The advantage 
of this Sum of Absolute Diflference calculation is that it avoids particular cases that have 
to be dealt with separately for a simple measurement of peak width. These particular 
cases would slow down flie computation if the inventors had chosen to perform a simple 
measurement of peak width. The Sum of Absolute Dijfferences calculation is therefore 
robust, and does not suffer significant delays in the computation. 

The Sum of Absolute Differences calculation is flie calculation referred to above with the 
formula: 

W{x, y,s) = ^ \p, {s) - p, 
i 

W is thus the sum of absolute differences, weighted by the scale s. 
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A simple 3-tap averaging may be applied to fhe peak widfh estimation prior to weighting 
the entropy value in order to increase the robustness to noise. Once the weighting value 
has been calculated, the value W(x,y,s) proportional to peak width estimate at each scale s 
is replaced with the average of ttie values at ^-1, s, and at+I . That average is 
OVfW'l) + W(x.y.sJ + W(w^l))/3 

At the minimum and maximum scales this opemtion would typically not be carried out. 
Region Selection and Clustering 

It is advantageous to robustly pick single points of entropy maxima. This relies on the 
persistence of these points in various imaging conditions, such as noise or small amounts 
of motion. It is known that the presence of noise in an image acts as a randomizer and 
generally increases the entropy value, affecting low entropy values more than high 
entropy values. However, the e£fect of noise also depends greatly on the shape of the local 
entropy surface around the maximum. Since the maximum point of a narrow peak is less 
affected by noise than that of a broad peak, the robustness of picking single points of 
entropy maxima then relies on the sharpness of ttie peak. 

The shape of the entropy sur&ce is dependent on three main factors: the original image 
intensity surface, the shape of the sampling window or Region Of Interest (ROI) and the 
size of the ROI (scale). The shape of the ROI is circular as this allows the entropy value 
to be rotationally invariant The dependence on the image surface is a result of a 
mismatch between the sampling ROI size and/or shape and the image feature of interest 
Assuming that the scale is adjusted correctly, and that the shape of ttie ROI is fixed, it 
follows that this dependence is not controllable, and ttiat picking single points in entropy 
space is not a robust mettiod. 

A more robust method would be to pick regions rather ttian points in entropy space. 
Although the individual pixels witiiin a salient region may be affected by the noise at any 
given instant, it is unlikely to affect all of them such that the region as a whole becomes 
non-salient 



wo 02/31766 



10 



PCT/EPOl/11715 



Reference is now made to Fig. 3. Fig. 3 is a simplified flowcliart illustration of a method 
for selecting salient regions, operative in accordance with a preferred embodiment of the 
preset invention. 

In the method of Fig. 3, only the regions of peak entropy as determined in Fig. 2 are 
processed. The processing of these regions is as follows. 

The peak region (xy,s) of highest saliency, as determined by the method of Fig. 2, is 
selected (step 300). The peak itself (3c,y,5; is defmed by 4e region's center point. 

The K nearest peak regions are thm selected (step 3 10). Nearness may be defined in 
(x,y,s) space based on a sum of the squares of the vector distance +/ + i). The value 
of if determines the noise robustness of the features being detected. A higher K value will 
result in larger regions with well specified properties being detected, for example an 
automobile in flie image. A smaller K value allows features of finer detail to be detected, 
for example a car antenna in the image. K is preferably adapted until a predefined 
variance threshold is exceeded. 

Once the K peak regions have been determined for the selected peak region, the mean and 
variance of x, y, and s are calculated for all flie selected regions (step 320). The largest of 
the three variances is then compared with a threshold. The value of the threshold may be 
set in accordance with known clustering algorithms, typically 0.7 (step 330). A variance 
that is less than the threshold typically indicates that the regions are well clustered, in 
which case the mean values of x, y, and s are then stored (step 340). 

Those of the K regions that are within a distance D multiplied by the mean(s) from the 
mean (x,y,s) point are then removed from the list of peak regions of saliency created by 
the method of Fig. 2 (step 350). D may be set to be any value or preferably an adaptive 
value related to the variance, such as a value proportional to 3 x standard deviatiorL 

A variance (step 330) that is greater than the threshold typically indicates that no 
clustering is found, in which case the point may be stored as an isolated point, the value 
of K may be reduced until clustering is attained, possibly down to a single point, or else 
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fhe point may simply remain in fhe list of salient points to see if it clusters in with 
anything else (step 370). 

Steps 300 - 350 are then performed on ttie next highest remaining region of peak entropy 
(stq> 360) until all regions of peak entropy have been processed, preferably in order of 
weighted peak entropy value. 

The present clustering method ttms accounts for the impact of noise on the saliency 
calculation of Fig. 2, and gives consideration to points of high entropy that are highly 
correlated in saliency space. 

If the regions are point regions, then the variance may be zero. Where only two regions 
are used in the calculation, the variance calculation may be discarded. 

Fig. 4 shows the results of an implementation of the method of Figs. 2 and 3. In Fig. 4, 
salient icons have been matched between the two images 30 and 32, using the method of 
the invention. In the implementation, salient regions and scales have been selected in two 
the images 30 and 32: The icons have been correlated, at 34, to find the best matching 
icons between the two images. 

Preprocessing stages may be used to reduce noise in the original image prior to canying 
out the methods described herein. Difiiision methods are widely known for their noise 
reduction and smoothing properties, and are widely cited as useful for generating scale- 
Sfpace representations of the original signal. Scale space mediods attempt to represent the 
original signal at a number of scales by successive smoothing operations. Although linear 
diffusion, which is equivalent to smoothing with a Gaussian filter, is considered to 
provide the most general smoothing, experimentation has shown that non-linear isotropic 
dif&ision and non-linear anisotropic difRision are preferable. Non-linear isotropic 
difiusion and non-linear anisotropic diffusion methods adjust the smoothing such that 
predefined significant edges are not smoothed. In non-linear isotropic diffusion, the 
smoothing is weighted by a local gradient function. In non-linear anisotropic difiusion, 
the smoothing is also directed to die direction of edges. Non-linear anisotropic difiusion 
also removes noise at edges. 
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TTnap ;e transmission method 

The present invention also comprises a method of image transmission. This meliiod of 
image transmission comprises the methods explained above. 

In particular, the methods of ranking pixels and of determining saliency in an image 
provide a way of identifying important regions of an image. Such identification can be 
used to identify parts of an image that are then transmitted preferentially. 

For example, an image may be transmitted over a radio link, to or from a mobile radio 
(PMR) or a mobile telephone. The bandwidth of the radio Imk available may restrict 
substantially the amount of data that can be transmitted from an image. The highly 
ranked pixels or most salient regions may be transmitted more often than other data. In 
fact, fliese may be the only portions of an image that are transmitted, for example 
during periods when an image changes rapidly with time. 

A pparatus 

The invention has been described above in terms of a method. However, ttie invention 
also comprises devices functioning in accordance with the invention. 

An embodiment of such a device is illustrated in appended figure 5. The device (500) of 
figure 5 serves to rank pixels in an image by degrees of saliency. The device comprises: 

a) means (510) for defining a plurality of regions for each of a plurality of pixels in an 
image (505), each of the regions having a different scale s for any one of said pixels at 
coordinates x,y; 

b) means (530) for calculating an entropy value for each of the regions; 

c) means (560) for identifying any peak entropy regions, the peak entropy regions being 
regions that include a peak entropy value; 

d) means (570) for weighting the peak ^tropy value of each of the peak entropy regions 
by a weight value corresponding to a peak width estimate of flie peak entropy value; 

e) means (590) for ranking the regions by the weighted peak entropy values, thereby 
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ranking the pixels. 

Also shown in figure S is an 'acquisition and frame structure* unit SOS, which includes a 
camera for scanning the image. Such a unit is known to the person skilled in the art, and 
hence is not described in further detail. The PDF estimator 520 provides the probability 
density function, as described above with referoice to tiie methods of the invention. 

The invention also extends to an image transmission device. The image transmission 
device comprises a device as explained above, and generally explained in connection with 
figure S. The image transmission device may select salient regions of an image for 
preferential transmission. Particularly where the transmission is over a radio link to or 
from a mobile or portable radio (PMR) or mobile telephone, the transmission may 
comprise the selected regions only, or these regions may be transmitted more frequently 
than other regions. 

The image transmission device may form part of a mobile or portable radio (PMR) or 
mobile telephone. 

Different Feature Mans 

In the basic method and apparatus of the invention, we have used the local distribution of 
intensity values as the descriptor for saliency. The invention is however not restricted to 
this. Any suitable feature map for the particular task at hand may be used. 

For example, in performing an analysis of fingerprint images, bifurcations and end-points of the 
ridges are commonly considered to be salient. For this task we use an edge direction feature map. 
The non-salient parts are those that consist of lines at a single scale and a single dominant direction. 
Bifurcations and end-points consist of many edge directions, and possibly scales. Instead of using 
die PDF of intensity values, we use the PDF of edge directions and scales. Figure 6 shows the most 
salient parts, and their respective scales, of a fingerprint image found using this method. See also 
figure?. 

Thus the method and apparatus of the invention can use any suitable feature map in the 
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determination of saliency. 
Matohm p Salient Regions 

Matching is a very common operation necessary in many computer vision tasks. For example, in 
object recognition the appropriate model from the object database must be found. This is 
cotmnonly done by exhaustively attempting to test the match between all models in the database and 
the image features. 

The saliency method of the present invention can improve the performance of such tasks by 
reducing the amount of data that needs to be stored for each model. This tiierefore reduces the 
complexity of the model search. It does fliis is two mains ways: 

(i) It reduces the number of descriptors that need to be stored. Only iJie salient regions are described. 

(ii) The respective scales for each salient region are stored. Hence Ihe dimensionality of the search 
space is reduced. This is because we know the scale of the salient bits, so there is no need to try out 
many scales between the model and the image. 

The appropriate descriptor for the task should be chosen such that it is more powerful (or 
descriptive) than the one used for the saliency feature map. In the matching examples shown in 
figure 4, we have used the vector of pixel values directly. This can be considered as a very powerfiil 
descriptor. 

In some applications it may be more appropriate to use less discriminating descriptors such as 
high-dimensional statistical or geometric invariants. These might provide benefits such as rotational 
or photometric invariance. 

Once the salient regions have been selected, they may be used in a matching task. 

The methods and apparatus disclosed herein have been described in a manner sufficient to 
enable persons of ordinary skill in the art to readily adapt commercially available 
hardware and software as may be needed to reduce any of the embodiments of the present 
invention to practice without imdue experimentation and using conventional techniques. 
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While the present invention has been described with reference to a few specific 
embodiments, the description is intended to be ilhistiative of the invention as a whole and 
is not to be construed as limiting the invention to the embodiments shown. It is 
appreciated that various modifications may occur to tiiose skilled in the art that, while not 
specifically shown herein, are nevertheless within the true scope of the invention. 
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Oafans 

1 . A method for taiddng pixels in an image by degrees of saliency, fhe method comprising 
the steps of: 

a) defining (200, 210) a plurality of regions for each of a plurality of pixels in an image, 
wherein each of said regions, for any one of said pixels at coordinates (x,y)^ has a 
different scale s\ 

b) calculating (230) an entropy value for each of said regions; 

c) identifying (260) any peak entropy regions, the peak entropy regions being regions 
which include a peak entropy value; 

d) weighting (270) said peak entropy value of each of said peak entropy regions by a 
weight value corresponding to a peak width estimate of said peak entropy value; and 

e) ranking (290) said regions by said weighted peak entropy values, thereby ranking said 
pbcels. 

2. A method according to claim 1 wherein said calculating step b) comprises calculating 
(220) a probability density function (PDF) estimate for said pixels within each of said regions. 

3. A method according to claim 2 wherein said calculating step b) comprises calculating 
(220) using a Parzen window PDF estimator. 

4. A method according to claim 2 wherein said calculating step b) comprises calculating 
(220) using histogram binning. 

5. A method according to claim 1 and further comprising the step of applying a 3-tap 
avemging to said peak width estimate prior to performing said weighting step d). 

6. A method according to claim 1 wherein said weighting step d) comprises weighting in 
accordance with a value W(x,y,s) according to tiie formula S(x,y,s) = H(x,y,s) ■ W(x,y,s) 
where 

Wix^y, s) = {s)- p,{s + \\s 
and H(x,y,s) is the local entropy. 
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7. A method for detenniiung regions of saliency in an image, the method comprising the 
steps of: 

a) defining (200, 210) a plurality of regions for each of a plurality of pixels in the image, 
wherein each of said regions for any one of said pixels at coordinates (x,y) has a different 
scale s\ 

b) calculating (230) an entropy value for each of said regions; 

c) identifying (260) any of said regions as having a peak entropy value; 

d) weighting (270) said peak entropy value of each of said peak entropy regions by a 
weight value corresponding to a peak width estimate of said peak entropy value; and 

e) for each selected one of said peak entropy regions (300): 

i) selecting (310) at least one neighboring region of peak entropy; 

ii) determining (320) the mean and variance of each of x, y, and s for said selected 
peak entropy region and said at least one neighboring region; and 

where the largest of said variances does not exceed a predetermined threshold (330): 

iii) removing (350) firom the set of said peak entropy regions any regions within a 
predetermined distance from said mean (x,y,s) point; and 

iv) storing (340) said mean values, thereby designating a region of interest. 

8. A metiiod according to claim 7 and further comprising performing step e) in order of 
said weighted peak entropy values. 

9. A method according to claim 7 or claim 8, wherein 
the regions are point regions and tiie variance is zero. 

10. A method according to any of claims 7-9, wherein 

there are only two regions, and the variance calculation is discarded. 

1 1 . A method of image transmission, comprising a method according to any previous 
claim. 
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12. A device (500) for ranking pixels in an image by degrees of saliency, comprising: 

a) means (510) for defining a plurality of regions for each of a plurality of pixels in an 
image (505), each of said regions having a different scale s for any one of said pixels at 
coordinates x,y; 

b) means (530) for calculating an entropy value for each of said regions; 

c) means (560) for identifying any peak entropy regions, the peak entropy regions being 
regions that include a peak entropy value; 

d) means (570) for weigjiting said peak entropy value of each of said peak entropy 
regions by a weigjit value corresponding to a peak width estimate of said peak entropy 
value; 

e) means (590) for ranking said regions by said weighted peak entropy values, thereby 
ranking said pixels. 

13. An image transmission device, comprising a device according to claim 1 1 for 
selecting salient regions of an image for preferential transmission. 
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